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I. INTRODUCTION 

Studies of B meson decays to three-body charmless hadronic final states are a natural extension 
of studies of decays to two-body charmless final states. Some of the final states considered so far 
as two-body (for example pn, K*it, etc.) proceed via quasi-two-body processes involving a wide 
resonance state that immediately decays in the simplest case to two particles, thereby producing 
a three-body final state. Multiple resonances occurring nearby in phase space will interfere and 
a full amplitude analysis is required to extract correct branching fractions for the intermediate 
quasi-two-body states. B meson decays to three-body charmless hadronic final states may provide 
new possibilities for CP violation searches P, QjHl- 

Observations of B meson decays to various three-body charmless hadronic final states have 
already been reported by the Belle liB, CLEO and BaBar collaborations. First results on 
the distribution of signal events over the Dalitz plot in the three-body B^ — > K^tt^tt^ and B^ 

K~ decays are described in Ref. |^. With a data sample of 29.1 fb~^ a simplified analysis 
technique was used due to lack of statistics. Using a similar technique, the BaBar collaboration has 
reported results of their analysis of the Dalitz plot for the decay B^ K^tt^tt^ with a 56.4 fb~^ 
data sample With the large data sample that is now available, we can perform a full amplitude 
analysis. The analysis described in this paper is based on a 140 fb~^ data sample containing 152 
million BB pairs, collected with the Belle detector operating at the KEKB asymmetric-energy e~^e~ 
collider with a center-of-mass (cm.) energy at the T{4S) resonance (on-resonance data). The 
beam energies are 3.5 GeV for positrons and 8.0 GeV for electrons. For the study of the e^e~ qq 
continuum background, we use 8.3 fb~^ of data taken 60 MeV below the T(4S') resonance (off- 
resonance data). 

The paper is organized as follows: Section ITll gives a brief description of the Belle detector; the 
event reconstruction procedure and background suppression techniques are described in Sections IlIII 
and IIVI respectively; Section describes results on the three-body signal yields measurement and 
qualitative analysis of the two-particle mass spectra, while Section IVII is devoted to the amplitude 
analysis of the observed three-body signals; final results of the analysis are given in Section I VIII 
and discussed in Section IVIIII 



II. THE BELLE DETECTOR 

The Belle detector is a large-solid- angle magnetic spectrometer based on a 1.5 T super- 
conducting solenoid magnet. Charged particle tracking is provided by a three-layer silicon vertex 
detector and a 50-layer central drift chamber (CDC) that surround the interaction point. The 
charged particle acceptance covers laboratory polar angles between 6 = 17° and 150°, correspond- 
ing to about 92% of the total solid angle in the cm. frame. The momentum resolution is determined 
from cosmic rays and e"'"e~ A*^/^^ events to be CTpJpt = (0.30 ©0.19pf)%, where pt is the trans- 
verse momentum in GeV/c. 

Charged hadron identification is provided by dE/dx measurements in the CDC, an array of 1188 
aerogel Cerenkov counters (ACC), and a barrel-like array of 128 time-of-flight scintillation counters 
(TOF); information from the three subdetectors is combined to form a single likelihood ratio, which 
is then used for pion, kaon and proton discrimination. At large momenta (> 2.5 GeV/c) only the 
ACC and CDC are used to separate charged pions and kaons since here the TOF provides no 
additional discrimination. Electromagnetic showering particles are detected in an array of 8736 
CsI(Tl) crystals (ECL) that covers the same solid angle as the charged particle tracking system. 
The energy resolution for electromagnetic showers is ue/ E = (1.3 © 0.07/ii^ © 0.8/ii^"'^/^)%, where 
E is in GeV. Electron identification in Belle is based on a combination of dE/dx measurements 
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in the CDC, the response of the ACC, and the position, shape and total energy deposition (i.e., 
E/p) of the shower detected in the ECL. The electron identification efficiency is greater than 92% 
for tracks with pi^b > 1-0 GeV/c and the hadron misidentification probability is below 0.3%. The 
magnetic field is returned via an iron yoke that is instrumented to detect muons and mesons. 
We use a GEANT-based Monte Carlo (MC) simulation to model the response of the detector and 
determine its acceptance 



III. EVENT RECONSTRUCTION 

Charged tracks are selected with a set of track quality requirements based on the number of 
CDC hits and on the distances of closest approach to the interaction point (IP). We also require 
that the track momenta transverse to the beam be greater than 0.1 GeV/c to reduce the low 
momentum combinatorial background. For charged kaon identification, we impose a requirement 
on the particle identification variable that has 86% efficiency and a 7% fake rate from misidentified 
pions. Charged tracks that are positively identified as electrons or protons are excluded. Since the 
muon identification efficiency and fake rate vary significantly with the track momentum, we do not 
veto muons to avoid additional systematic errors. 

We identify B candidates using two variables: the energy difference /S.E and the beam-energy 



constrained mass Mbc. is calculated as /S.E = Eb — E^^^^ = - yc^pf + c^mfj — E^^^^, 
where the summation is over all particles from a B candidate; and pi and rrii are their cm. three- 
momenta and masses, respectively. Since the T(45) decays to a pair of B mesons with no additional 
particles, each B meson carries half of the cm. energy \/s/2 = E^^^^ = 5.29 GeV, where -E^eam 
is the beam energy in the cm. frame. The AE distribution for the B~^ K^tt^tt" signal MC 
events is shown in Fig. Q^a). Since there are only charged particles in final states considered in 
this analysis, the AE width is governed by the track momentum resolution. A typical value of 
the AE resolution is 15 MeV. The beam energy spread is about 3 MeV and gives a negligible 
contribution to the total AE width. The signal AE shape is fitted by a sum of two Gaussian 
functions with a common mean. In fits to the experimental data, we fix the width and fraction 
of the second Gaussian function from MC simulation. The width of the main Gaussian is floated. 
For comparison, the AE distribution for the off-resonance data is also shown in Fig. E^a), where 
the background is parametrized by a linear function. 

The beam-energy constrained mass variable Mbc is equivalent to the B invariant mass with the 

measured B candidate energy Eb replaced by the beam energy -Ebeam- -^bc = -E'jJeam ~ '^^■^s ~ 



-^heam ~ ''^(Si P«)^' where P_B is the B candidate momentum in the cm. frame. The average 
B meson momentum in the cm. frame is about 0.34 GeV/c which is much smaller than its total 
energy. Thus, the uncertainty in the measured gives a small contribution to the Mbc width, 
which is dominated by the beam energy spread. The Mbc width is about 3 MeV/c^ and is nearly 
independent of the final state unless photons are included. The Mbc distribution for the signal 
B^ K^TT^TT^ MC events and for the off-resonance data are shown in Fig. H^b). The signal 
Mbc shape is well described by a Gaussian function. The background shape is parametrized with 
an empirical function /(Mbc) xVl — x'^ exp[— A(l — x^)], where x = Mbc/i^beam ^^'^ A is a 
parameter |l^ . 
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FIG. 1: (a) Energy difference AE and (b) beam constrained mass Mbc distributions for K^TT^Tr~ 
signal MC events (histograms) and qq background in ofF-resonance data (points). Curves represent the 
results of the fits. 



IV. BACKGROUND SUPPRESSION 

There are two sources of the background: the dominant one is due to e+e" QQ {q = u, d, s 
and c quarks) continuum events that have a cross-section about three times larger than that for 
the e^e~ T(4S') — > BB; the other one originates from other B meson decays. The background 
from continuum events is suppressed using variables that characterize the event topology. Since 
the two B mesons produced from an T{4S) decay are nearly at rest in the cm. frame, their 
decay products are uncorrelated and the event tends to be spherical. In contrast, hadrons from 
continuum qq events tend to exhibit a two-jet structure. We use ^thn which is the angle between 
the thrust axis of the B candidate and that of the rest of the event, to discriminate between 
the two cases. The distribution of | cos6'thr| is strongly peaked near | cos^thrl = 1-0 for qq events 
and is nearly flat for BB events. A Fisher discriminant is utilized for the further suppression of 
the continuum background. When combined, these two variables reject about 98% (92%) of the 
continuum background in the B^ — > K~^TT~^Tr~ {B^ — > K~) decay while retaining 36% 

(70%) of the signal. (As the continuum background in the three-kaon final state is much smaller 
a looser requirement on the Fisher discriminant is imposed to retain the efficiency.) A detailed 
description of the continuum suppression technique can be found in f3] and references therein. 

The understanding of the background that originates from other B meson decays is of great 
importance in the study of charmless B decays. We study the BB related background using a 
large sample (about 2.5 times the experimental dataset) of MC generated BB generic events. We 
use the CLEO generator to simulate B decays. Note that charmless hadronic B decays are 
not included in the QQ98 generator and are generated separately. We find that the dominant BB 
background in the K^tt^tt^ final state that peaks in the signal region is due to B^ D^7r~^, 
DO K+TT- and also B+ J/'0(V'(25))if+, J/xp{ip{2S)) fi+fi~ decays. We_veto B+ 
I)°7r+ events by requiring \M{K7r) - Md\ > 0.10 GeV/c^. The B+ D^K+, Z)° vr+vr- 
signal is removed by requirement |M(7r"*"7r^) — M£)\ > 15 MeV/c^ (~ 2.5a). To suppress the 
background due to ir/K misidentification, we also exclude candidates if the invariant mass of 
any pair of oppositely charged tracks from the B candidate is consistent with the — > K~^Tr~ 
hypothesis within 15 MeV/c^, regardless of the particle identification information. Modes with 
J/'ip{ip{2S)) in the final state contribute due to muon-pion misidentification; the contribution from 
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the J /ij){il){2S)) — > e^e submode is found to be negligible after the electron veto requirement. 
We exclude J/ip{'ip{2S)) background by requiring |M(7r+7r-)^+^- - Mj/^l > 0.07 GeV/c^ and 
|M(7r+7r~)^+^- — M0(2S)I > 0.05 GeV/c^, where subscript fJ-^fJ-~ indicates that the muon mass 
assignment was used for charged tracks to calculate the two-particle invariant mass. Yet another 
small but clearly visible background associated with J/^K~^ , J/tp f^^ft^ decays is due 

to a somewhat complicated particle misidentification pattern: the charged kaon is misidentified as 
a pion, the //^ is misidentified as a kaon and the /x~ as another pion. This background is excluded 
by applying a veto: \M{K'^tt~)^+^- — Mj/^\ > 0.020 GeV/cP. The most significant background 
from charmless B decays is found to originate from — > ij'K^ followed by tj' — > 7r"^7r~7. Another 
contribution comes from B^ p^TT~^ decay, where one of the final state pions is misidentified as a 
kaon. We take these contributions into account when determining the signal yield. 

The dominant background to the K"^K^K~ final state from other B decays is found to come 
from the process B Dh, where h stands for a charged pion or kaon. To suppress this background, 
we reject events where any two-particle invariant mass is consistent with — > K^K~ or — > 
K~'K^ within 15 MeVc^ regardless of the particle identification information. We find no charmless 
B decay modes that produce a significant background to the K^K~^K~ final state. 

V. THREE-BODY SIGNAL YIELDS 

The Ai? distributions for B^ K^tt^tt^ and B^ K^K~^K~ candidates that pass all 
the selection requirements and with \M^c ~ < 9 MeV/c^ are shown in Fig. ^ where clear 
peaks in the signal regions are observed. In the fit to the AE distribution for the K^tt^tt^ final 
state, we fix the shape and normalization of the charmless BB background components from the 
measured branching fractions ^3] and known number of produced BB events. For the BB generic 
component, we fix only the shape and let the normalization float. The slope and normalization 
of the qq background component are free parameters. Results of the fit are shown in Fig. [21 
where different components of the background are shown separately for comparison. There is a 
large increase in the level of the BB related background in the AE < —0.15 GeV region for the 
iC+7r^7r~ final state. This is mainly due to the decay B — > Dir, D — > Knir. This decay mode 
produces the same final state as the studied process plus one extra pion that is not included in the 
energy difference calculation. The decay B Dtt, D K^u^ also contributes due to muon-pion 
misidentification. The shape of this background is described well by the MC simulation. In the 
fit to the AE distribution for the K~ final state, we fix not only the shape but also the 

normalization of the BB background. This is done because the BB background in this final state 
is found to be much smaller than the dominant qq background, thus the relative fraction of these 
two contributions is poorly determined from the fit. The signal yields obtained from fits are given 
in Tabled 

To examine possible quasi-two-body intermediate states in the observed B^ — > i^+vr+vr^ and 
B^ K~ signals, we analyze two-particle invariant mass spectra. To determine the 

distribution of the background we use events in the Mbc and AE sidebands. The definition of the 

TABLE I: Results of fits to the AE distributions with a double Gaussian for the signal (see Section III). 



Final state 


(Jl CT2 


Fraction of the 


Signal Yield 




MeV McV 


main Gaussian 


(events) 




17.5 ± 0.9 35.0 (fixed) 


0.84 (fixed) 


1533 ± 69 


K+K+K- 


14.0 ± 1.0 40.0 (fixed) 


0.85 (fixed) 


1089 ± 41 
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FIG. 2: AE distributions for (a) B+ K+n+n^ and (b) K+K+K^ candidate events. Points with 

error bars are data; the curve is the fit result; the hatched area is the background. 



signal and sideband regions is illustrated in Fig. IHI Defined in this way, the Mbc — Ai? sidebands 
are equivalent to the following sidebands in terms of the three-particle invariant mass M{Khh) 
and three-particle momentum P[Khh) in the cm. frame: 

0.05 GeV/c^ < \M{Khh) - Mb\ < 0.10 GeV/c^; P{Khh) < 0.48 GeV/c 

and 

\M{Khh) - Mb\ < 0.10 GeV/c^; 0.48 GeV/c < PiKhh) < 0.65 GeV/c. 
The signal region is defined as an ellipse around the Mbc and AE mean values: 

(Mbc-Mg)^ ^ AE^ ^ 1 

where omt^c — ^ MeV/c^ and a^E is equivalent to ui in TableQ] We define two signal regions: with 
loose (n = 3) and tight (n = 2) requirements. Tight requirements reduce (compared to the loose 
requirements) the background fraction in the data sample by about 65% while retaining about 
85% of the signal. The efficiency of the loose (tight) requirements that define the signal region is 
0.923 (0.767) for the i^+vr+vr- final state and 0.948 (0.804) for the K+K+K' final state. The 
total number of events in the signal region is 2584 (1809) for the i^+vr+vr^ and 1400 (1078) for the 
K^K^K" final state. To determine the relative fraction of signal and background events in these 
samples, we use the results of the fits to the AE distributions (see Table P). We find 1533 it 69 
signal — > i^+vr+vr" events and 1089 it 41 signal B'^ — > K^K^K~ events. The relative fraction 
of signal events in the signal region with loose (tight) requirements is then determined to be 
0.548 ±0.025 (0.650 ±0.032) for the K+tt+tt- and 0.738 ± 0.028 (0.828 ± 0.033) for the K+K+R- 
final state. All final results are obtained from fits to events in the signal region with loose AE and 
Mbc requirements. The subsample with tight requirements is used for a cross-check only. 

The K^TT^ and vr+vr^ invariant mass spectra for B~^ K~^it^tt~ candidate events in the 
Mbc — loose signal region are shown as open histograms in Fig. |3 The hatched histograms 
show the corresponding spectra for background events in the Mbc ~ sidebands, normalized 
to the estimated number of background events. To suppress the feed-across between the vr^vr" 
and K^Tr~ resonance states, we require the K^tt^ (tt+tt") invariant mass to be larger than 2.0 
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FIG. 3: (a) Distribution of Ai? versus Afbc for the i?+ K^K^K candidates in data, (b) Definitions of 
the signal and sideband regions in the Afbc — AS plane. 



(1.5) GeV/c^ when making the it~^-k~ [K~^-k~) projection. The K~^-k~ invariant mass spectrum is 
characterized by a narrow peak around 0.9 GeV/c^, which is identified as the i('*(892)^, and a broad 
enhancement around 1.4 GeV/c^. Possible candidates for this enhancement are the scalar i^Q(1430) 
and tensor iir2(1430) resonances. In the tt'^'k" invariant mass spectrum two distinct structures in 
the low mass region are observed. One is slightly below 1.0 GeV/c^ and is consistent with the 
/o(980) and the other is between 1.0 GeV/c^ and 1.5 GeV/c^. We cannot identify unambiguously 
the resonant state that is responsible for such a structure. Possible candidates for a resonant state 
in this mass region might be /o(1370), /2(1270) and perhaps /3(1450) 0|. In what follows, we 
refer to this structure as /x(1300). There is also an indication for the p{nQi)^ . Finally, there is a 
clear signal for the decay — > XcoK~^ , XcO vr+vr". Figure Efc) shows the vr+vr" invariant mass 
distributions in the XcO mass region. 

The K~^K~ invariant mass spectra for K^K^K~^ candidate events in the Mbc — AE 

signal region with loose requirements are shown as open histograms in Fig. 13 Since there are 
two same-charge kaons in the K^K~^K~ decay, we distinguish the K^K~ combinations 

with smaller, M{K+K~) 

mill) and larger, M {K~^ K )max) invariant masses. The M [K~^ K )min 
spectrum, shown in Fig. |Sfa), is characterized by a narrow peak at 1.02 GeV/c^ corresponding 
to the (/>(1020) meson and a broad structure around 1.5 GeV/c^, shown in Fig. El^b). Possible 
candidates for a resonant state in this mass region are the /o(1370), /o(1500) or /2(1525) [l3 |. In 
what follows, we refer to this structure as /x(1500). FigureEIc) shows the M{K^ K~)^n^ invariant 
mass distribution in the XcO niass region. A clear enhancement is observed at 3.4 GeV/c^, where 
the XcO is expected. Some enhancement of signal events over the expected background level is also 
observed in the full mass range shown in Fig. E^c). As the XcO nieson has a significant natural 



width (about 15 MeV/c^) [ij], the amplitude that is responsible for the B^ XcqK~^ decay may 
interfere with a charmless amplitude. As a result of the interference between these two amplitudes, 
the lineshape of the XcO resonance can be distorted. In our previous analysis of B meson decays to 
three-body charmless hadronic final states IH| i we imposed a requirement on the invariant mass 
of the vr+vr" and K~^K~ combination to veto the B^ — > XcoK~^ signal. In this analysis we do not 
apply such a requirement. 

From these qualitative considerations it is apparent that an amplitude analysis is required for 
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FIG. 4: Two-particle invariant mass spectra for if+Tr+vr^ candidates in the B signal region (open 

histograms) and for background events in the AE — Mbc sidebands (hatched histograms), (a) M{K'^n^) 
spectrum with M{n+TT-) > 1.5 GeV/c^; (b) M{n+TT-) with M{K+tt-) > 2.0 GeV/c^ and (c) Min+n ) 
in the Xco mass region with M{K^tt~) > 2.0 GeV/c^. 




0.98 1.00 1.02 1.04 1.06 1.08 1.0 1.5 2.0 2.5 3.0 3.5 4.0 3.0 3.2 3.4 3.6 3.8 4.0 



M(K*K") (GeV/c') > .in <GeV/c') M(K*K")„,^ (GeV/c'j 

FIG. 5: Two-particle invariant mass spectra for B^ K^K^K^ candidates in the B signal region (open 
histograms) and for background events in the Ai? — Afbc sidebands (hatched histograms), (a) M{K^ K^)^i^ 
invariant mass spectrum near the (/)(1020) mass region; (b) M(_fC+iir~)min spectrum in the full range; (c) 
M(K+if-)max in the XcO mass region with 2.0 GeV/c^ < M{K+K-)nv,n < 3.4 GeV/c^. 

a more complete understanding of the individual quasi-two-body channels that contribute to the 
observed three-body K^tt^it~ and signals. 



VI. AMPLITUDE ANALYSIS 

In the preceding Section we found that a significant fraction of the signals observed in B^ 
i^+7r+7r~ and B^ K~^K^K~ decays can be assigned to quasi-two-body intermediate states. 
These resonances will cause a non-uniform distribution of events in phase space that can be analyzed 
using the technique pioneered by Dalitz . Multiple resonances that occur nearby in phase space 
will interfere and provide an opportunity to measure both the amplitudes and relative phases of the 
intermediate states. This in turn allows us to deduce their relative branching fractions. Amplitude 
analyses of various three-body D meson decays have been successfully performed by a number of 
groups From their results we can learn that this kind of analysis requires, in general, high 

statistics (of the order of a few thousand signal events, at least). In contrast to the analysis of D 
meson three-body decays, where the level of the combinatorial background is usually quite small, 
the signal and background levels in charmless three-body decays of B mesons are comparable. 
This complicates the analysis, requiring careful study of the distribution of background events 
over the phase space. Finally, independent of the statistics, the choice of the model (that is the 
set of quasi-two-body intermediate states) to fit the data is often not unique. This unavoidably 
introduces some model dependence into the determination of quasi-two-body branching fractions. 
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TABLE II: Blatt-Weisskopf penetration form factors. Pr is the momentum of either daughter in the meson 
rest frame, ps is the momentum of either daughter in the candidate rest frame (same as Pr except the parent 
mass used is the two-track invariant mass of the candidate rather than the mass of the meson). R is the 
meson radial parameter. 



Spin J Form Factor 

1 





1 

2 



This is especially true for three-body charmless decays of B mesons where experimental statistics 
is quite limited while the available phase space is large. 



A. Formalism 

Since we are studying the decay of a spin-zero particle to three spin-zero daughters B /ii/i2^3) 
only two degrees of freedom are required to completely describe the kinematics. There are three 
invariant masses that can be formed by considering all possible pairs of final state particles: si2 = 
M^(/ii/i2), si3 = M'^{hihs) and S23 = M^(/i2/i3). Only two of them are independent, however, 
since energy and momentum conservation results in the additional constraint 

+ml+ml+ml = S12 + si3 + S23, (1) 

where is the mass of the initial particle, and rrii are masses of the daughter particles. In what 
follows we use S13 and S23 as the two independent variables. 

The density of signal events on the Dalitz plot is described by the matrix element A4 as 

which in turn depends on the decay dynamics. 

The amplitude for B decay to a three-body final state via an intermediate resonance state R is 
given by 

Aj = FbFI^^'^BWjTj, (3) 
where Fb and F^"^ are form factors which, in general, are unknown functions. For F^^ we use 



the Blatt-Weisskopf penetration factors 13] given in Table ^ These factors depend on a single 
parameter, R, which is the "radius" of the meson. For all intermediate resonances we set this 
parameter to i? = 1.5 GeV~^. Form factors are normalized to unity at the nominal meson mass. 
Fb is parametrized in a single pole approximation [l^ 

Fb = r-^-^ (4) 

pole 

where we use the mass of the B* meson (l3 | as a pole mass Mpoie- 

The Breit-Wigner function BWj in Eq. (j^j) is given by the expression 

BWj{s) = — ^ rn-, (5) 
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where Mr is the nominal mass of the resonance, and r^'*(s) is the "mass dependent width". In 
the general case, r^^(s) is expressed as (l9| : 



Pr 

where pr is the momentum of either daughter in the resonance rest frame, calculated with the 
resonance mass equal to the nominal M/j value, ps is the momentum of either daughter in the 
resonance rest frame when the resonance mass is equal to s^^^, J is the spin of the resonance, and 
Tr is the width of the resonance. 

The function Tj in Eq. © describes the angular correlations between the B decay products. 
We distinguish the following three cases: 

1) Scalar-Pseudoscalar (J = 0) decay 

If i? is a scalar state, the decay amplitude Eq. Q takes the simplest form with Tq = 1. We 
treat the scalar /o(980) as a special case, for which we try two parametrizations for the s-dependent 
width rjQ(s): by Eq. ©, and following the parametrization by Flatte [i^] 

Tf,{s) = Kis) + TK{s), (7) 

where 



r^is) = gWs/^-ml, Tk{s) = ^ - mj^^ + ^s/A - m 



2 



(8) 



and g-ir and gx are coupling constants for /o(980) — > vrvr and /o(980) KK, respectively. 

2) Vector-Pseudoscalar (J = 1) decay 

In the case of a pseudoscalar-vector decay of the B meson, the Lorentz-invariant expression for 
Ti is given by 

Tl(/Il/12/J3|i?23) = S12-S13 + ^ ^, (9) 

■S23 

where -R23 is an intermediate resonance state decaying to /i2^3 final state. 

3) Tensor-Pseudoscalar (J = 2) decay 

For a pseudoscalar-tensor decay, T2 takes the form 

T2(/ll/l2/l3|^23) = Ul3 - Si2 + ^ ^^^^ 

V S23 



- - S23 - 2M| - 2ml + — ] {S23- 2ml - ^^l + — — ■ 10) 

3 V S23 / V S23 / 

We do not consider resonant states of higher spin in our analysis. 

There is also the possibility of a so-called "non-resonant" amplitude. In the Dalitz analysis of 
D meson decays to three-body final states the non-resonant amplitude is often parametrized as a 
complex constant. In the case of B meson decays, where the available phase space is much larger, 
it is rather unlikely that the non-resonant amplitude will have a constant value over the entire 
phase space; some form factors should be introduced. Unfortunately, at the moment there is no 
theoretical consensus on the properties of non-resonant B meson decays. In our analysis we use 
an empirical parametrization that in the case of the K^tt^tt^ final state is 

Anr{K+7r+7r~) = a?''e-"'^"e^'^" + a^' e-""'^' e'^^\ (11) 
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where S13 = M'^{K~^tt~), S23 = M^(7r"'"7r~), and a™2) and 5" 2 and a are fit parameters. In a 
certain limit this parametrization is equivalent to a constant. Several alternative parametrizations 
(mentioned below) are also considered to estimate the model dependence. 

An important feature that should be taken into account in the construction of the matrix 
element for the decay B'^ — > K~^K^K~ is the presence of the two identical kaons in the final state. 
This is achieved by symmetrizing the matrix element with respect to the interchange of the two 
kaons of the same charge, that is S13 <-> S23- Due to symmetrization the non-resonant amplitude 
for the K^K^K~ final state becomes 

Anr{K+K+K-) = a"'-(e-°^» + e-"'^^)e'^''\ (12) 

where S13 = M'^{KfK-), S23 = M'^{K^K-). 

Given the amplitude for each decay type, the overall matrix elements can be written as a 
coherent sum 

M = ^aje'^^A^+A^r. (13) 
i 

where the index j denotes the quasi-two-body intermediate state, aj and 5j are the amplitude 
and relative phase of the j-th component. Since we are sensitive only to the relative phases and 
amplitudes, we are free to fix one phase and one amplitude in Eq. The fraction // of the total 
three-body signal attributed to a particular quasi-two-body intermediate state can be calculated 

as 

^ / I aM'Pds 13^^23 

/|A^|2dsi3dS23 ■ ^ ^ 

The sum of the fit fractions for all components is not necessarily unity because of interference. 

The amplitude analysis of B meson three-body decays reported here is performed by means of 
an unbinned maximum likelihood fit which minimizes the function 

.F=-2 ^ lnP(si3,S23;e), (15) 

events 

where the function -P(si3, ,523; describes the density of experimental events over the Dalitz plot; 
^ is a vector of parameters. 

An important question that arises in an unbinned analysis is the estimation of the goodness- 
of-fit. As the unbinned maximum likelihood fitting method does not provide a direct way to 
estimate the quality of the fit, we need a measure to assess how well any given fit represents the 
data. To do so the following procedure is applied. We first subdivide the entire Dalitz plot into 
1 (GeV/c^)^xl (GeV/c^)^ bins. If the number of events in the bin is smaller than A^min = 16 it is 
combined with the adjacent bins until the number of events exceeds Aj^iin- After completing this 
procedure, the entire Dalitz plot is divided into a set of bins of varying size, and a variable for 
the multinomial distribution can be calculated as 

X^ = -2 Vn.ln(^), (16) 



=1 



where is the number of events observed in the z-th bin, and pi is the number of predicted 
events from the fit. For a large number of events this formulation becomes equivalent to the 
usual one. Since we are minimizing the unbinned likelihood function, our "x^" variable does not 
asymptotically follow a distribution but it is bounded by a variable with (A^bins — 1) degrees 
of freedom and a variable with (Abins — k — 1) degrees of freedom (2l|, where k is the number 
of fit parameters. Because it is bounded by two x^ variables, it should be a useful statistic for 
comparing the relative goodness of fits for different models. 
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B. Efficiency, Detector Resolution and Background 

Several effects should be taken into account when fitting the experimental data. The reconstruc- 
tion efficiency can vary significantly over the Dalitz plot area and distort the initial distribution 
of signal events. In addition, there is also some fraction of background that fakes the signal. As 
is evident in Fig. |2 the background level in the signal region is comparable to that of the signal. 
Thus, understanding the distribution of background events over the Dalitz plot is important for 
an amplitude analysis. Finally, the detector resolution produces some smearing of the Dalitz plot 
boundaries so that the phase space for the reconstructed B candidates exceeds the kinematically 
allowed area. To correct for this effect, three-body combinations are kinematically fit to the nom- 
inal B mass. As the intermediate resonances in general have large widths, we neglect the effect of 
detector resolution on the resonance shapes in most cases. In the case of narrow resonant states (for 
example, the (p meson in the K^K^K^ final state or the XcO in both K^K^K^ and K^tt^tt^ final 
states), we take the detector resolution into account by convolving the signal probability density 
function with a two-dimensional Gaussian resolution function. The widths of the two-dimensional 
resolution function depend on the position in the Dalitz plot and are determined from the MC 
simulation. 

To account for the background events and non-uniform reconstruction efficiency the event den- 
sity function, -P(si3,S23;C) can be written as 

Ns J £{Sl3,S23)^{Sl3,S23,OdSl3dS23+nb 

where Ng is the initial number of signal events distributed over the the Dalitz plot according to the 
signal density function S{si3, S23, ! ^(■siS) •S23) is the reconstruction efficiency as a function of the 
position on the Dalitz plot, rii, is the expected number of the o6ser?;ed background events distributed 
with the density b{si3, S23), and a vector of parameters ^ (masses, widths and relative amplitudes 
and phases) is to be determined from the minimization. Equation ()17() can be written in terms of the 
expected number of the observed signal events Ug = NgSs = Ng J £{si3, S23)S{si3, S23,(,)dsi3ds23 
and the background density function -6(513,523) = efe&(si3, S23)/e(si3, S23): 

/ .nsS{si3,S23,(.)/es+nbB{si3,S23)/£:b 
P{Sl3, S23,0 = £{si3, S23) : , (18) 

Us + Ub 

where the overall efficiencies Eg and £b are determined from the MC simulation: 

e(si3, S23)S{si3, S23,OdSl3dS23 = ^T^ ^ S'(si3, S23,Oi (19) 

^^^"'^ MC 

^(•513, S23)B{si3, S23)dsi3dS23 = — ^ ^(si3, •823)- (20) 

^^S™ MC 

The sum X^mc calculated from a set of MC events generated with a uniform distribution over 
the Dalitz plot, passed through the full detector simulation and subjected to all the event selection 
requirements; iVgen is the number of generated events; A is the Dalitz plot area. 
The likelihood function to be minimized can be written as 

T= - X^'^lnTp -^(^13,^23,0 p^ B{S13,S23) \ 

J- Z^^^'M-^v- c-z^MC „MC t^ ^-^ ^>sp 0/ MC „MC^ ) 

events ^ Z^MC'-'v*13 '^23 Z^MC-°l*13 ' *23 I/ 

- 21ne(si3,523) + (21) 

events 
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FIG. 6: Dalitz plots for events in the /\E - Afbc sidebands for the (a) X+tt+tt" and (b) K+K+K^ (right) 
final states. 



where signal and background density functions are normalized to satisfy the requirement 

j S{si3,S23,0dsi3dS23 = I; j B{si3, S23)dsi3dS23 = 1, (22) 

F = Ug/ (ns + rib) is the relative fraction of signal events in the data sample and Fq is the estimated 
fraction from the fit to the AE distribution. The third term takes into account the uncertainty in 
our knowledge of the background contribution. As the second term in Eq. (|21|) does not depend 
on the fit parameters ^, it is constant for a given set of experimental events and, thus, can be 
omitted. In Eq. (|21|) we assume there is no interference between signal and background processes. 
The background density function B{si3, S23) is determined from the unbinned likelihood fit to the 
experimental events in the Mbc — AE sidebands. 



C. Fitting the Background Shape 

The definition of the Mbc — AE sideband region is shown in Fig. |31 Figure shows the Dalitz 
distributions for events in these sidebands; we find 7360 and 2176 events for the X+tt+tt" and 
K~ final states, respectively. This is about seven times the estimated number of background 
events in the corresponding signal region. 

We use the following empirical parametrization to describe the distribution of background events 
over the Dalitz plot in the i^^vr^vr^ final state 



BKnAsi3,S23) = aie-^^'^'^ + a2e-P^'^' + age 



+ 046 



-/34(S13+S23) _|_ Q,^^g-/35(S13+Sl2) _|_ Q,gg-/36(s23+Sl2) 



+ 7i|Wi(i^*(892))|2 + 72|Wi(p(770))p 



(23) 



where S13 = M^(K"'"7r~), S23 = M^(7r"'"7r~) and (ai = 1.0), /3j and 7^ are fit parameters. 
The first three terms in Eq. (|23|1 are introduced to describe the background enhancement in the 
two-particle low invariant mass regions. This enhancement originates mainly from e^e~ qq 
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FIG. 7: Results of the best fit to the iiT+Tr+Tr" (left column) and K~^K~^K~ (right column) events in the 
AE — Mbc sidebands shown as projections onto two-particle invariant mass variables. Points with error bars 
are data; histograms are fit results. The inset in (e) shows the (/i(1020) mass region in 2 MeV/c^ bins. 



continuum events. Due to the jet-like structure of this background, all three particles in a three- 
body combination have almost collinear momenta. Hence, the invariant mass of at least one pair 
of particles is in the low mass region. In addition, it is often the case that two high momentum 
particles are combined with a low momentum particle to form a B candidate. In this case there 
are two pairs with low invariant masses and one pair with high invariant mass. This results in 
even stronger enhancement of the background in the corners of the Dalitz plot. This is taken into 
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TABLE III: Parameters of the background density functions determined from the fit to events in the Mbc — 
AE sidebands. 
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account by terms 4 — 6 in Eq. 1)23^ . To account for the contribution from real i^*(892)'^ and p(770)*^ 
mesons, we introduce two more terms in Eq. that are (non-interfering) squared Breit-Wigner 

amplitudes (as in Eq. Q), with masses and widths fixed at world average values 0]. For the 
final state the following, somewhat more complicated, parametrization is used 

Bkkk{su,S2z) = ai(l-a2(s23-5)')e-'^^(v^~^^) + 03(1 - 04(^23 - <5)2)e-^3(v^-^^) 

+ ^i\BW{(^)\\ (24) 

where S13 = mln{M'^{Kt K-),M'^{K:^ R-)], S23 = ma^{M^{K^ K'), M^{K} R-)}, S12 = 
M'^{K~^ K~^) and §53 i^u) is the minimal possible value (determined by phase space) for S13 (S12), 
given the value of S23 • 

The projections of the data and fits for the background events are shown in Fig.[7| The numerical 
values of the fit parameters are given in Table IIIH The x^/^hms values of the fits to the Dalitz 
plots are 213.7/195 for the /C+tt+tt" and 57.6/66 for the K^K^K'' final state, respectively. 



D. Fitting the B+ -> X+tt+tt Signal 



The Dalitz plot for K~^Tr~^TT~ events in the signal region is shown in Fig. |HJa). There are 2584 
events in the signal region that satisfy all the selection requirements. In an attempt to describe 
all the features of the K~^7r~ and 7r"'"7r~ mass spectra mentioned in Section we start with the 
following minimal matrix element for the — > i^^vr^vr" decay (referred to as model Ktttt—Aj): 

+ ape'^''AiiK+TT+TT-\p{770f) + af,/^foAo{K+7r^TT-\foi980)) 

+ af^e'^fxAj{K+7T+7T~\fx) + a^^,/^^^oAo{K+TT+7T~\xco), (25) 

where the subscript J denotes the unknown spin of the /x(1300) resonance; amplitudes Oj, relative 
phases Si, masses and widths of the /o(980) and /x(1300) resonances are fit parameters. The 
masses and widths of all other resonances are fixed at their world average values [ij] . While fitting 
the data, we choose the X*(892)'^7r^ signal as our reference by fixing its amplitude and phase 
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FIG. 8: Dalitz plots for events in the signal region for the (a) K^tt^tt and (b) K^K^K final states. 



{aK* = 1 and 5k* = 0). Figures ini^a,b,c) show the fit projections with model i^vrvr— Aq and the 
data t23]. The numerical values of the fit parameters are given in Table ITVl However, the data are 
not well represented by this matrix element, especially in the low K~^'k~ mass region as shown in 
Fig-Eta). This is also demonstrated in Fig. IIUI where the K~^ii^ invariant mass distributions are 
shown for the two M'^{'k+tt-) regions: Af2(7r+7r~) < 11 GeV/c^ and M'^{'K+'n~) > 11 GeV/c^, 
which approximately correspond to the two helicity angle regions: cosO^'^ < and cos^^'^ > 0, 
respectively. Result of the fit using model Kirir—AQ is shown as a dashed histogram in Fig. 1101 
(The helicity angle is defined as the angle between the direction of flight of the vr" in the K+TT- 
rest frame and the direction of K~^tt~ system in the B rest frame.) The difference in shape of the 
M(K~^7r~) spectra clearly observed in Figs. ITnT al and llOf b) is consistent with what is expected 
in the case of interference of vector and scalar amplitudes. The scalar amplitude introduced by 
the ii'Q(1430)'^ state is found to be insufficient to reproduce this pattern. Thus, we modify the 
matrix element fEa. I25|) by introducing an additional scalar amplitude. First, we construct model 
Ktttt—'Bj, that is model Ktttt—Aj with an additional scalar K~^7r~ resonance. A candidate for such 
a state could be the so-called k resonance. An indication of the presence of the k in — > K~Tr~^TT~^ 
decay with M(k) = 797 ± 19 ± 43 MeV/c^ and r(K) = 410 ± 43 ± 87 MeV/c^ was reported by the 
E791 collaboration [2^. Results of the fit with model Ktttt—Bq are summarized in Table ITVl The 
agreement with the data is somewhat improved as compared to the model Xvrvr— Aq. However, if 
the mass and the width of the k are allowed to float, the fit finds M("k") = 1.23 it 0.07 GeV/c^ 
and FC'k") = 2.41 it 0.26 GeV/c^. Both the mass and the width differ from those for the k state 
measured by the E791 collaboration. On the other hand, a scalar amplitude with such a large width 
could be an indication of the presence of a non-resonant amplitude. To check this hypothesis, we 
construct model Kittt—Cj, that is model Kittt—Aj plus a non-resonant amplitude parametrized by 
Eq. (|11|) . Results of the fit with model Kmr—Co are given in Table ITVl and shown in Figs. intd,e,f). 

The mass and width of the /x(1300) state obtained from the fit with model Kmr—Co are 
consistent with those for the /o(1370) 0|. If a tensor amplitude is used for the /x(1300) 
state (model if7r7r-C2), the fit finds M(/x(1300)) = 1.377 ± 0.038 GeV/c^ and r(/x(1300)) = 
0.085 ± 0.031 GeV/c2 (-21og/: = -4013.0; xV^bin = 103.8/106), which disagree with the 
world average /2(1270) parameters (l3 |. In the case of a vector amplitude (model Ktttt—Ci), 
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TABLE IV: Summary of fit results to ii'+7r+7r events in the signal region. The two values given for model 
KniT— Co correspond to two solutions (see text for details). 



Parameter 




Model 








Kmr—Ao 


Kmr—^o 


Kmr-Co 
Solution 1/Solution 2 


K* (892)°7r+ 


fraction, % 


18.0 ± 1.4 


14.1 ±1.3 


13.7± 1.1/12.6± 1.3 




phase, ° 




(fixe 


d) 


ii:o(1430)°7r+ 


fraction, % 


42.1 ±3.7 


48.6 ±3.4 


58.4 ±2.7/10.7 ±2.8 




phase, ° 


11±8 


73 ±9 


36±7/-ll±9 


p{770)°K+ 


fraction, % 


11.2 ± 1.4 


9.85 ± 1.20 


10.0 ± 1.5/8.18 ±0.92 




phase, ° 


-17± 18 


25 ±25 


-52 ± 18/47 ±25 


fn(980)K+ 


fraction % 


16.5 ± 1.5 


17.4 ± 1.7 


15.8 ± 2.5/14.0 ± 1.4 




phase, ° 


33± 19 


74 ±23 


20 ± 16/94 ± 17 




Mass, GeV/c^ 


0.975 ±0.004 


0.976 ±0.004 


0.976 ±0.004/0.975 ±0.003 




Width, GcV/c2 


0.063 ±0.009 


0.065 ±0.009 


0.061 ± 0.009/0.053 ±0.009 




fraction % 


3.56 ±0.93 


3.09 ±0.87 


2.86 ±0.58/2.13 ±0.67 




phase, ° 


-124 ± 16 


-37 ± 24 


-29±23/-15±22 


f-x-(1300)K+ 


fraction, % 


6.70 ± 1.42 


6.14 ± 1.50 


5.47 ±2.47/3.75 ±1.70 




phase, ° 


160 ± 18 


185 ±21 


158± 18/-134±22 




Mass CeV/r^ 


1.369 ±0.026 


1.344 ± 0.026 


1.369 ±0.026/1.400 ±0.028 




Width GeV/c^ 


0.220 ± 0.063 


0.227 ±0.070 


0.185 ±0.052/0.165 ±0.048 




fraction, % 




20.3 ±0.0 






phase, ° 




-139 ±6 






Mass, GeV/c2 





0.797 (fixed) 







Width, GeV/c2 


— 


0.410 (fixed) 


— 


Non- Resonant 


fraction, % 


— 


— 


36.2 ±3.2/40.1 ±5.2 






- 


- 


0.34 ±0.09/0.42 ±0.09 






- 


- 


-25 ± 7/8 ±8 




rnr o 






140± 16/-146± 13 




a 






0.102 ± 0.023/0.106 ± 0.022 


Charmless Total" 










fraction, % 


97.7 ±0.6 


96.6 ±0.8 


97.5 ±0.7/97.6 ±0.6 


-21n£ 


-3845.3 


-3966.6 


-4041.8/-4024.4 






227.8 


129.0 


104.2/107.1 




-^bins 


106 


106 


106 




-^fit.var. 


14 


16 


19 



° Here "Charmless Total" refers to the total three-body — > if+Tr+Tr signal excluding the 
contribution from XcO^^ . 
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FIG. 9: Results of the fit to K'^7r~^Tr~ events in the signal region with model Ktttt—Aq (left column) and 
model Kmr—Co (right column). Points with error bars are data, the open histograms are the fit result and 
hatched histograms are the background components. Insets in (a) and (d) show the i^*(892) — /Cq (1430) mass 
region in 20 MeV/c^ bins. Insets in (b) and (e) show the Xco mass region in 25 MeV/c^ bins. Note that for 
plots (a) and (d) ((b) and (e)) an additional requirement M(7r+7r-) > 1.5GeV/c^ {M{K+tt^) > 1.5GeV/c^) 
is imposed. 



the fit gives M(/x(1300)) = 1.330 ± 0.019 GeV/c^ and r(/x(1300)) = 0.210 ± 0.048 GeV/c^ 
(-2 log/: = -4048.1; xV^bin = 105.5/106). Based on this study, we choose model Ktttt-Co 
as our default and obtain all the final results for the — > K~^Tr~^TT~ decay using this model. 
Figure ITT] shows the M{K+7r") (M(7r+7r")) distributions in slices of M2(7r+7r-) {M'^{K+7r-)) to 
allow a more detailed comparison of the data and fit results with model Kmr—Co. 

In addition to the two-particle invariant mass distributions shown in Figs.lHland llll the helicity 
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FIG. 10: K^-K invariant mass distributions for K^ti^tt events with (a) Af^(7r+7r ) < 11 GeV/c^ and 
(b) M2(7r+7r-) > 11 GeV/c^. 



angle distributions for several regions are shown in Fig. (For the vr+vr" combination the helicity 
angle is defined in a similar way as for K~^'k~ combination.) All plots shown in Fig. II 21 demonstrate 
good agreement between data and the fit. 

To test for the contribution of other possible quasi-two-body intermediate states such as 
K*(1410)°7r+, /i:*(1680)°7r+, /s:^(1430)°7r+ or /2(1270)/r+, we include an additional amplitude 
of each of these channels in model Ktt'k—Cq and repeat the fit to data. None of these channels 
have a statistically significant signal. 

To estimate the model dependent uncertainty in the branching fractions for individual quasi- 
two-body channels, we use the results of fits obtained with models i^vrvr— Bj and Ktttt—Cj + R, 
where R is one of an additional resonances mentioned above. We also use different parametrizations 
of the non-resonant amplitude to estimate the related uncertainty. We try the following alternative 
parametrizations: 



Ar(A'+7r+7r~ 

AnriK+TT+TT- 
AnAK+TT+TT- 



-e'"2 ; 



While fitting the data with model Kmr—CQ, we found that two solutions with very similar 
likelihood values exist. The comparison between the two solutions and the data are shown in Fig. 111! 
The main difference between these two solutions is the relative fractions of the total K^tt^tt~ 
signal ascribed to the — > iCQ(1430)'^7r+ decay: the fraction of this channel changes by a factor 
of about five. The reason for the existence of the second solution is similar behavior of the two 
amplitudes (the non-resonant component parametrized by Ea. ()ll() and the scalar ITq (1430)*^7r"'" 
amplitude) as functions of M'^{K'^it~). Due to the large width of the i<'Q(1430)'' resonance, these 
two amplitudes can be, to a large extent, interchanged providing a nearly identical description 
of the data. An even stronger effect is observed in the case of model i^vrTr— Bq when the mass 
and width of the "k" resonance is allowed to float. In this case the two amplitudes are almost 
identical. A similar behavior is observed for all the parametrizations used to describe the non- 
resonant amplitude. The existence of secondary maxima of the likelihood function is confirmed 
with MC simulation (see Section fVIIII for the more detailed discussion). 
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FIG. 11: M{K+Tr-) (M(7r+7r")) distributions in slices of Af(7r+7r") {M{K+tt~)). Points with error bars 
are data, the open histograms are the fit results with model A'tttt— Co and the hatched histogram is the 
background component. Solid and dotted histograms correspond to Solution 1 and Solution 2, respectively 
(see Table Hvl and text for details). 
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FIG. 12: Helicity angle distributions for K+tt+tt- events in different regions: (a) K*{892f (0.82 GeV/c^ < 
M{K+n-) < 0.97 GeV/c^); (b) is:o*(1430)0 (1.0 GeV/c^ < M{K+tt-) < 1.76 GeV/c^); (c) p(770)0 
(M(7r+7r-) < 0.90 GeV/c^) and (d) /o(980) (0.90 GeV/c^ < M{Tr+7r~) < 1.06 GeV/c^). Points with error 
bars are data, the open histogram is the fit result with model i^TTTTr— Cq and the hatched histogram is the 
background component. Visible irregularities are due to vetoes applied on invariant masses of two-particle 
combinations. 



E. Fitting the B+ K+K+R- Signal 

The Dalitz plot for events in the signal region is shown in Fig.|Sl^b). There are 1400 

events in the signal region. In the analysis of the K'^ final state we follow the same strategy 

as in the case of the i^+vr+vr" state. In an attempt to describe all the features in the K~^K~ 
mass spectrum mentioned in Section we start with the following minimal matrix element of the 
B'^ K^K^K^ decay (referred to as model KKK—Aj): 



(26) 



Sa{K+K+K-) = a^e'^^ {AiiK^ K-\(l)) + Ai{K+ K+ K 

+ a^^,e''-^o {Ao{K+K}K-\xco) + Ao{K} K+ \xco)) 
+ ajj'ix {Aj{K+K+K-\fx) + Aj{K+KtK-\fx)) , 

where the subscript J denotes the unknown spin of the /x(1500) resonance; amplitudes Oj, relative 
phases 5i, mass and width of the /x(1500) resonance are fit parameters. As there are two identical 
kaons in the final state, the amplitude in Eq. (|26|) is symmetrized with respect to <-> K2 
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TABLE V: Summary of fit results to K^K^K events in the signal region. The two values given for model 
KKK—^Q correspond to the two solutions (see text for details). 



Parameter 




Model 




KKK-Ao 


KKK-Bo 
Solution 1 /Solution 2 


(I){IQ2Q)K+ fraction, % 


14.0 ± 1.2 


14.7 ± 1.3/15.2 ± 1.3 


phase, ° 


-17± 11 


-123± 10/-200± 10 


/x(1500)i^+ fraction, % 


83.3 ±2.5 


63.4 ± 6.9/8.21 ± 1.94 


phase, ° 




(fixed) 


Mass, GeV/c2 


1.373 ±0.025 


1.524 ±0.014/1.491 ±0.018 


Width, GeV/c2 


0.720 ±0.058 


0.136 ±0.023/0.145 ±0.029 


XcoK'^ fraction, % 


4.48 ± 1.4 


2.67 ± 0.82/8.01 ± 1.35 


phase, ° 


165 ± 15 


-118± 15/127± 10 


Non-Resonant fraction, % 


- 


74.8 ±3.6/65.1 ±5.1 


phase, ° 




-68 ± 9/61 ± 10 


a 




0.121 ± 0.014/0. 116± 0.015 


Charmless TotaP 






fraction, % 


96.0 ±0.7 


95.2 ±1.0/95.6 ±0.9 


-21n£ 


-2140.4 


-2218.2/-2177.4 




65.0 


43.3/57.1 




53 


53 


-^fit.var. 


6 


9 



" Here "Charmless Total" refers to the total three-body B+ K+K+K^ 
signal excluding the contribution from XcaK^ . 



interchange. When fitting the data, we choose the /x(1500)i^+ signal as our reference by fixing its 
amplitude and phase (a/^^ = 1 and Sf-^^ =0). Figures ITHT a.b.c) show the two-kaon invariant mass 
projections for model KKK—Aq and the data. The numerical values of the fit parameters are given 
in Table Ivl Although the data are described relatively well even with this simple matrix element, 
there is a region where the agreement is not satisfactory. The enhancement of signal events in the 
higher K^K~ mass range visible in Fig. Il.sr a) causes the width of the /x(1500) state determined 
from the fit with model KKK—Aq to be very large. This results in a poor description of the data in 
the M{K'^ K^) ~ 1.5 GeV/c^ region, where the peaking structure is significantly narrower. On the 
other hand, as for K~^7r~^TT~ , the excess of signal events at high M{K~^K~) may be evidence 

for non-resonant — > K~^K~^K~ decay. To test this hypothesis, we extend model KKK—Aj to 
include a non-resonant amplitude (model KKK—Hj) parametrized by Eq. (|12j) . Results of the fit 
with model KKK—Jio are shown in Figs. ll^f d.e.f): numerical values of the fit parameters are given 
in Table Ivl The agreement with data is significantly improved compared to model KKK—Aq. 
In order to check the sensitivity of the data to the spin of the /x(1500) state, we replace the 
scalar amplitude by a vector (model KKK—Jii) or a tensor (model KKK—Yi2) amplitude for 
the /x(1500) with its mass and width as free parameters. The scalar hypothesis gives the best 
fit. Figure El shows a detailed comparison of the fit and the M{K~^ K~)^\^ (M(if"'"ir~)max) 
distributions for different slices of M'^{K^ K^)ja&x (Af^(i^"''i^~)min)- Finally, Fig. [T31 shows the 
helicity angle distributions for the (f) and /x(1500) regions. Based on these results, we choose 
model KKK—YiQ as the default. All of the final results for the decay B^ K^ K^ K^ are based 
on this model. 



24 




0.5 1 1.5 2 2.5 3 3.5 
M(kV) .„ (GeV/c^) 




0.5 1 1.5 2 2.5 3 3.5 
M(kV) .„ (GeV/c^) 



> 

o 

m 
o 



ID 

c 

0) 

> 



80 



60 



40 



20 




0.5 1 1.5 2 2.5 3 3.5 4 4.5 
M(kV)^ (GeV/c^) 




0.5 1 1.5 2 2.5 3 3.5 4 4.5 
M{kV)„_ (GeV/c^) 



> 

(1) 

m 
o 



m 
c 

0) 

> 




0.5 1 1.5 2 2.5 3 3.5 4 4.5 
M(kV) (GeV/c^) 




0.5 1 1.5 2 2.5 3 3.5 4 4.5 
M(kV) (GeV/c^) 



FIG. 13: Results of the fit with the model KKK-Aq (left column) and KKK-Bq (right column) to 
events in the signal region. Points with error bars are data, the open histogram is the fit result and 
hatched histogram is the background component. Insets in (a) and (d) show the 0(1020) mass region in 
2 MeV/c^ bins. Insets in (b) and (e) show the XcO mass region in 25 MeV/c^ bins with an additional 
requirement 2.0 GeV/c^ < M{K+K-)^in <3.4 GeV/c^ 
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FIG. 14: M{K+K-)„,in {M{K+K-)n,^^) distributions in slices of M{K+K-)rni,^ {M{K+K-)n,in)- Points 
with error bars are data, the open histograms are the fit results with model KKK—Jio and the hatched his- 
togram is the background component. Solid and dotted histograms correspond to Solution 1 and Solution 2, 
respectively (see Table fVl and text for details). 
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cos (Sg) COS (Sg) 

FIG. 15: Helicity angle distributions for events in the (a) mass region {M{K^ K~)^in < 1.05 GeV/c^) and 
in the (b) /jf (1500) region (1.05 GeV/c^ < M{K+K-)^in < 3.0 GeV/c^). Points with error bars are data, 
the open histogram is the fit result with model KKK—Bo and the hatched histogram is the background 
component. 

To estimate the model dependent uncertainty in the relative fractions of individual quasi-two- 
body intermediate states and determine the contribution of other possible quasi-two-body inter- 
mediate states, we modify model KKK—Bq to include an additional decay channel and repeat 
the fit to the data. In particular we test the (j){1680)K^ , f2{1525)K'^ and a2(1320)i^"*" channels. 
In all cases the fit finds no statistically significant signal for the newly added channel. Since we 
observe a clear /o(980)/C"'" signal in the i^+vr+vr^ final state, we try to include the /o(980)i^"'" 
amplitude in the — > matrix element as well: no statistically significant contribution 

from this channel is found. As the dominant model uncertainty is related to the parametrization 
of the non-resonant amplitude, we use several alternative, yet also arbitrary, parametrizations to 
estimate the relevant uncertainty: 

• An,{K+K+K-) = af (e""'^" + g-'^'^^s) gi^r + afe-°''^^e'^^'] 
. ^„,(K+E:+i^-) = ar(4 + 4)e^^-; 

• Anr{K+K+K-) = a'''e'^''\ 

As in the case of — > K~^tt~^tt~ , we find two solutions in the fit to K~ events with 

model KKK—Bq. The comparison between the two solutions and the data are shown in Fig. 1141 
The main difference in these two solutions is in the fraction of the — > fx{^500)K'^ signal which 
changes by about an order of magnitude. Results for both solutions of the K K K —Bq model are 
given in Table IVl 

F. MC pseudo-experiments 

The parameters that are directly determined from the fit to data are the amplitudes and phases 
with their statistical errors. However, while the relative fraction for a particular quasi-two-body 
channel depends only on the corresponding amplitude in the matrix element, its statistical error 
depends on the statistical errors of all amplitudes and phases. To determine the statistical errors 
for quasi-two-body channels, we use a MC pseudo-experiment technique. 
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MC pseudo-experiments are MC generated samples which are the proper mixture of "signal" and 
"background" events distributed according to density functions determined from the fit to experi- 
mental events. For each model we generate 100 statistically independent MC pseudo-experiments 
with numbers of signal and background events equal to those found in the experiment, fit these 
MC samples, and determine the relative fractions /; of quasi-two-body channels for each sample. 
The /; distributions are then fit by a Gaussian function; the sigma of the Gaussian determined 
from the fit is assigned as the statistical error. 



VII. BRANCHING FRACTION RESULTS &: SYSTEMATIC UNCERTAINTIES 

In previous sections we determined the relative fractions of various quasi-two-body intermediate 
states in three-body i^+vr+vr" and — > K^K~^K~ decays. To translate those values into 

absolute branching fractions, we first need to determine the branching fractions for the three-body 
decays. To determine the reconstruction efficiency for the — > K^tt^tt^ and B^ K^K^K~ 
decays, we use a MC simulation where events are distributed over phase space according to the 
matrix elements of model Kitit—Cq and model KKK—Bq, respectively. The corresponding recon- 
struction efficiencies are 21.1 ±0.2% and 22.3ib0.2%. Results of the branching fraction calculations 
for the total three-body charmless B^ K^-k^tx^ and B^ K^K~^K~ decays j2^ and all the 
quasi-two-body intermediate channels are summarized in Table IVll where the first quoted error is 
statistical, the second is systematic and the third is the model uncertainty. Branching fractions for 
i? — > h~^h~ decays are taken from |l^ . 

For most of the quasi-two-body channels the difference in branching fractions from the two 
solutions is relatively small and treated as model error. However values for the B~^ (1430)''7r"'" 
branching fraction are substantially different for the two solutions and we quote both values in 
Table IVII For the B~^ XcqK^ decay we present both solutions for the XcO — > K~^K~ channel; 
for the final result we calculate the central value combining measurements in XcO n^ii^ channel 
and the best fit in XcO K^K~ channel, the second solution in XcQ K^K~^ channel is used for 
model error estimation. As the interpretation of the /x(1300) and /x(1500) states is uncertain, 
we do not quote the corresponding branching fractions. 

For quasi-two-body channels where no significant signal is observed, we calculate 90% confidence 
level upper limits /go for their fractions. To determine the upper limit we use the following formula 

\'t'Gia,a-x)dx , , 

Jq Lx\a^a\x)ax 

where G'(a, a\ x) is a Gaussian function with the measured mean value a for the signal fraction 
and its statistical error a. To account for the model uncertainty we determine the resonance's 
contribution with different parameterizations of the non-resonant amplitude and use the largest 
value to evaluate the upper limit. To account for the systematic uncertainty we decrease the 
reconstruction efficiency by one standard deviation. 

The dominant sources of systematic error are listed in Table IVIll For the branching fractions of 
three-body B~^ K~^iT^ir~' and B^ K'^K^K~ decays, we estimate the systematic uncertainty 
due to variations of the reconstruction efficiency over the Dalitz plot by varying the relative phases 
and amplitudes of the quasi-two-body states within their errors. The systematic uncertainty due 
to requirements on event shape variables is estimated from a comparison of their distributions 
for signal MC events and B^ D^tt^ events in the data. We estimate the uncertainty in the 
signal yield extraction from the fit to the AE distribution by varying the parameters of the fitting 
function within their errors. The uncertainty due to background parametrization is estimated by 
varying the relative fraction of the BB background component and the slope of the qq background 
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TABLE VI: Summary of branching fraction results. The first quoted error is statistical, the second is 
systematic and the third is the model error. The branching fraction values in this table are obtained from 
the product of the appropriate fractions in Tables IIVI and with the branching ratios obtained from the 
signal yields in Table Note that the yields in Table include XcO contributions. The charmless total 
fractions in this table exclude the XcO contribution. The value given in brackets for the Kq{1430)'^tt^ and 
XcqK^ channels corresponds to the second solution (see text for details). 



iVlOQC 


tj[-D — > itfi ) X Oyit — > n It ) X iu 


K( j:>+ , T>h + \ V 1 n6 


K~^7r'^7T~ charmless total 




46.6 ±2.1 ±4.3 




6.55 ± 0.60 ±0.60to;5y 


9.83 ± 0.90 ± 0.90tQ;86 


i^o(I430)"7r+, Kq{1A30)^ K+tt 


27.9 ± 1.8 ± 2.6_5;4 


45.0 ± 2.9 ± 6.21 g y 




(5.12 ± 1.36 ± 0.49Iq 5]^) 


(8.26 ± 2.20 ± 1.19Ig ga) 


A (1410)'7r+, K {\A\Qy a+tt 


< 2.0 




A (loSOj^TT^, A (1680)^ K^TT 


< 3.1 




X2(I430)"7r+, K2{14:30)° K+tt~ 


< 2.3 






A 'ici 1 r» 1 r\ a /t -1-0.91 

4.78 ± 0.75 ± 0.441q gy 


A 1 n 1 r\ a /t -1-0.91 

4.78 ± 0.75 ± 0.44Iq gy 


/o(980)i4:+, /o(980) TT+TT 


7.55 ± 1.24 ± 0.69_Q gg 




/2(1270)i4:+, /2(1270) TT+TT 


< 1.3 




Non-resonant 




17.3 ± 1.7 ± 1.6Iy g 


K+K^K~ charmless total 




30.6 ± 1.2 ±2.3 


(t)K+, (t)-^ K+K- 


4.72 ± 0.45 ±0.35t^:^^ 


9.60 ± 0.92 ±0.7ltEJ;I^ 


(/)(I680)if+, (/)(1680) ^ K+K- 


< 0.8 




fo{980)K+, /o(980) ^ K+K^ 


< 2.9 




/^(1525)if+, /^(1525) ^ K+K- 


< 4.9 




a2{l320)K+, 02(1320) ^ K+R- 


< 1.1 




Non-resonant 




24.0 ± 1.5 ± l.Stg;? 


XcqK^, XcO TT+TT" 


1.37 ± 0.28 ± 0.121° 






0.86 ± 0.26 ±0.06t^:o^ 






(2.58 ± 0.43 ±0.19l:|5:og) 




XcqK'^ combined 




196 ± 35 ± 33^26^ 



function within their errors. The uncertainty from the particle identification efficiency is estimated 
using pure samples of kaons and pions from K~it~^ decays, where the flavor is tagged 

using D*^ D^-K~^. The systematic uncertainty in charged track reconstruction is estimated using 
partially reconstructed D* — > Dtt events and from comparison of the ratio of r/ ^ tt^tt^-k^ to — > 
77 events in data and MC. The overall systematic uncertainty for the three-body branching fraction 
is estimated to be ±9.2% and ±7.4% for the i^+vr+vr" and K~^K^K~ final states, respectively. 

VIII. DISCUSSION & CONCLUSION 

With a 140 fb~^ data sample collected with the Belle detector, we have performed the first 
amplitude analysis of B meson decays to three-body charmless i^+vr+vr" and K~^K^K~ final 
states. Clear signals are observed in the B+ if*(892)07r+, B+ p{770fK+, B+ fo{980)K+ 
and B~^ — > (f)K^ decay channels [i^. The model uncertainty for these channels is relatively small 
due to the narrow width of the intermediate resonances and (in vector-pseudoscalar decays) due 
to vector meson polarization which provides clear signal signatures. 

The branching fraction measured for the decay B~^ — > Er*(892)'^7r+ is significantly lower than 
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TABLE VII; Contributions to the systematic uncertainty (in percent) for the three-body K^tt^tt 
and B+ K^K^K^ branching fractions. 



Source Error 







K+K+K- 


Efficiency nonuniformity 


1.2 


0.7 


Event Shape requirements 


2.5 


1.7 


Signal yield extraction 


5.4 


2.1 


PID 


6.0 


6.0 


Charged track reconstruction 


3.0 


3.0 


MC statistics 


1.0 


1.0 


Ngg estimation 


1.0 


1.0 


Total 


9.2 


7.4 



that reported earlier ip]. The simplified technique used for the analysis of the — > K^tt^-k~ 
decay described in |5|, lal has no sensitivity to the relative phases between different resonances, 
resulting in a large model error. The full amplitude analysis presented in this paper consistently 
treats effects of interference between quasi-two-body amplitudes thus reducing the model error. The 
analysis suggests the presence of an additional (presumably non-resonant) amplitude in the mass 
region of the i^*(892)° that absorbs a significant fraction of the B signal. The B^ K*{892) ir^ 
branching fraction measured in our analysis is in better agreement with theoretical predictions 
based on the QCD factorization approach [2^ . 

The decay mode B^ — > fQ{980)K~^ is the first observed example of a B decay to a charmless 
scalar-pseudoscalar final state. The mass M(/o(980)) = 976±4+^ MeV/c^ and width r(/o(980)) = 
61 ± 9^3"^ MeV/c^ obtained from the fit are in agreement with previous measurements |l4l |. To 
check the sensitivity of the results to the parametrization of the /o(980) lineshape, we repeat the 
fit with the Flatte lineshape {20] ■ In this case, because of limited statistics, we fix gx at the value 
reported by the E791 Collaboration [23]: 5/4- = 0.02 ± 0.04 ± 0.03. Since the central value for gx 
measured in is consistent with zero, we also make a fit to data with g^ fixed at zero. Finally 
we repeat the fit with both g.,^ and gx fioated. In all cases we obtain consistent results. The 
sensitivity to the B~^ fQ{980)K~^ decay in the K~^K^K~ final state is greatly reduced by the 
large B'^ cpK'^ amplitude and by the scalar non-resonant amplitude. No statistically significant 
contribution from this channel to the K~^K~^K~ three-body final state is observed, thus only a 
90% confidence level upper limit for the corresponding branching fractions product is reported. 

We report the first observation of the decay B^ p{770)^ . The statistical significance [2^ 
of the signal exceeds 60" with all the models used to fit the B'^ K^tt^tt^ signal. The measured 
branching fraction for this channel agrees well with the theoretical prediction in QCD factoriza- 
tion [2^. This is one of the channels where large direct CP violation is expected jjfl ]. 

Due to the very narrow width of the (p meson, the branching fraction for the decay B'^ — > (l)K~^ 
is determined with a small model uncertainty. The obtained value is in good agreement with 
previous measurements [2^. 

A clear signal is also observed for the decay B^ XcO^^ in both XcO 7r"*"7r~ and XcO 
K^K~ channels. Although quite significant statistically, the B^ — > XddK~^ signal constitutes only 
a small fraction of the total three-body signal and thus suffers from a large model error, especially 
in the K~ final state, where the charmless non-resonant amplitude in the XcO mass region 

is enhanced compared to the i^+vr+vr" final state due to the interference caused by the presence 
of the two identical kaons. 

We also check possible contributions from B+ i^|(1430)°7r+, B+ E:*(1410)°7r+, B+ 
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K*(1680)°7r+ and B+ /2(1270)K+ decays. In the K+K+K' final states we check for the 
/2(1525)K+, B+ a2(1320)K+ and B+ (f){1680)K+ signals. We find no statistically 
significant signal in any of these channels. As a result, we set 90% confidence level upper limits for 
their branching fractions. In the factorization approximation, charmless B decays to pseudoscalar- 
tensor final states are expected to occur at the level of 10~^ or less jiof . 

For other quasi-two-body channels the interpretation of fit results is less certain. Although a 
signal for B~^ — > JCq (1430)'^7r''" is observed with a high statistical significance, its branching fraction 
is determined with a large model error. Two solutions with significantly different fractions of the 
B^ i^Q(1430)'^7r"'' channel but similar likelihood values are obtained from the fit to K~^tt^tt~ 
events. Study with MC simulation confirms the presence of the second solution. We prepare MC 
pseudo-experiments where the B~^ — > i^^7r^7r~ signal is generated with the matrix element of 
model Kmr—Co with parameters corresponding to one of the solutions. In both cases the second 
solution is found in the fit to MC samples. It is also worth mentioning that the two solutions exist 
with all the parameterizations of the non-resonant amplitudes we tested. This may indicate that 
in order to choose a unique solution additional external information is required. In this sense, the 
useful piece of information seems to be the phenomenological estimation of the B^ — > Kq {1^30)^11^ 
branching fraction . The analysis of B meson decays to scalar-pseudoscalar final states described 
in Ref. suggests that the branching fraction for the B'^ — > i^'Q(1430)'^7r+ decay can be as large 
as 40 X 10~^. Unfortunately, the predicted value suffers from a large uncertainty that is mainly 
due to uncertainty in calculation of the ii'Q(1430) decay constant fx*- Different methods used to 
estimate fx* |^,E1] give significantly different results. We may also try to resolve the ambiguity by 
employing independent information from other experiments. For example, analysis of the real and 
imaginary parts of the amplitude separately may provide additional useful information. Following 
the idea by BaBar Collaboration |2f)l | (see also discussion below), we employ LASS results on the 
partial wave analysis of the elastic K-tt scattering 33] . We compare the total scalar K-ir amplitude 
(which is a sum of the B^ i^Q (1430)^^71"^ amplitude and the K-tt component of the non-resonant 
amplitude Eq. with that measured by LASS. From this comparison, we find that results of 
the best fit (model Knir—Co, solution I) to the K^tt^tt^ signal events are in good qualitative 
agreement with the LASS data. 

We cannot identify unambiguously the broad structures observed in the M{-k'^'k^ ) ~ 1.3 GeV/cP 
mass region in the B^ K^tt'^tt" decay denoted in our analysis as /x(1300) and at M{K^ K~) ~ 
1.5 GeV/c^ in the B'^ K^K^K~ decay denoted as /x(1500). If approximated by a single 
resonant state, /x(1300) is equally well described by a scalar or vector amplitude. Analysis with 
higher statistics might allow a more definite conclusion. The best description of the /x(1500) is 
achieved with a scalar amplitude with mass and width determined from the fit consistent with 
/o(1500) states Q. 

Amplitude analysis often suffers from uncertainties related to the non-unique parametrization of 
the decay amplitude. In our case such an uncertainty originates mainly from the parametrization of 
the non-resonant amplitude. In this analysis, we use a rather simplified empirical parametrization 
with a single parameter. In the study of the B~^ — > ET+vt+tt" decay by the BaBar Collaboration ,2^] 
a different approach is used. In their analysis, an attempt is made to parametrize -fCQ(1430)'^7r"'" and 
the non-resonant component by a single amplitude suggested by the LASS collaboration to describe 
the scalar amplitude in elastic Kti scattering Although this approach is experimentally 

motivated, the use of the LASS parametrization is limited to the elastic region of M{Ktt) < 
2.0 GeV/c^. Besides, an additional amplitude (a complex constant) is still required for a satisfactory 
description of the data ji^] • 

It is worth noting that fractions of the non-resonant decay in both B^ K^tt^tt~ and B^ 
K~^K~^K~ decays are comparable in size and comprise a significant fraction of the total three- 
body signals. Moreover, in the parametrization used in this analysis the numerical values of the 
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parameter (parameter a in Eas. (|ll() and ()12() ) for the i^+vr+vr" and K~^K~^K~ are 

very close. This may indicate that the non-resonant amphtudes in both final states have a common 
nature, and simultaneous analysis of these two decay modes may impose additional constraints. 
An attempt for such an analysis has been made in [2J|. However, the proposed model considers 
only the vr-vr component {a^ in Eq. 1)11(1 ) of the non-resonant amplitude and does not account 
for the K-TT component (a™ in Eq. ()11|) ). while in our analysis we find that the K-ir component 
dominates (see Table HVj) . 

In some cases the uncertainty in the parametrization of the non-resonant amplitude significantly 
affects the extraction of relative fractions of other quasi-two-body channels. Further theoretical 
progress in this field might allow reduction of this uncertainty. 

Results of the — > Dalitz analysis can be also useful in connection with the 

measurement of CP violation in K^K^K^ decay reported recently by the Belle [s^ and 

BaBar j^B] collaborations. An isospin analysis of B decays to three- kaon final states by Belle ^ 
and independent analysis with moments technique [s^] by BaBar js^ suggest the dominance of 
the CP-even component in the B^ K^K^K~ decay (after the B^ ^^S^^^ is excluded). 

This conclusion can be checked independently by an amplitude analysis of the KgK~^K~ final 
state, where the fraction of CP-odd states can be obtained as a fraction of states with odd orbital 
momenta. Unfortunately, such an analysis is not feasible with the current experimental data 
set. Nevertheless, the fact that we do not observe any significant vector amplitude other than 
B^ — > (j)K~^ in the decay B~^ — > K~ supports the conclusion. 
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